Computing Equilibria in Anonymous Games 
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Abstract 

We present efficient approximation algorithms for 
finding Nash equilibria in anonymous games, that is, 
games in which the players utilities, though different, 
do not differentiate between other players. Our results 
pertain to such games with many players but few strate- 
gies. We show that any such game has an approximate 
pure Nash equilibrium, computable in polynomial time, 
with approximation 0(s 2 \), where s is the number of 
strategies and A is the Lipschitz constant of the utili- 
ties. Finally, we show that there is a PTAS for finding 
an e-approximate Nash equilibrium when the number of 
strategies is two. 



1 Introduction 

Will you come to FOCS? This decision depends on 
many factors, but one of them is how many other the- 
oreticians will come. Now, whether each of them will 
come depends in a small way on what you will do, and 
hence this aspect of the decision to go to FOCS is game- 
theoretic — and in fact of a particular specialized sort 
explored in this paper: Each player has a small num- 
ber of strategies (in this example, two), and the utility 
of each player depends on her/his own decision, as well 
as on how many other players will choose each of these 
strategies. It is crucial that the utilities do not depend on 
the identity of the players making these choices (that is, 
we ignore here your interest in whether your friends will 
come). Such games are called anonymous games, and in 
this paper we give two polynomial algorithms for com- 
puting approximate equilibria in these games. In fact, 
our algorithms work in a generalized framework: The 
players can be divided into a few types (e.g., colleagues, 
students, big shots, etc.), and your utility depends on 
how many of the players of each type choose each of the 
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strategies. 

Notice that this is a much more general framework 
than that of symmetric games (where all players are 
identical); each player can have a very individual way 
of evaluating the situation, and her/his utility can de- 
pend on the choices of others in an individual arbitrary 
way; in particular, there may be no monotonicity: For 
example, a player may prefer a mob with 1000 atten- 
dees, mostly students, to a tiny workshop of 20, while a 
medium-sized conference of 200 may be more attractive 
than either; a second player may order these in the exact 
opposite way. Anonymous games comprise a broad and 
well studied class of games (see e.g. HE] 021 f° r recent 
work on this subject by economists) which are of special 
interest to the Algorithmic Game Theory community, as 
they capture important aspects of auctions and markets, 
as well as of Internet congestion. 

Our interest lies in computing Nash equilibria in such 
games. The problem of computing Nash equilibria in a 
game was recently shown to be PPAD-complete in gen- 
eral d2), even for the two-player case [6 1. Since that neg- 
ative result, the research effort in this area was, quite 
predictably, directed towards two goals: (1) comput- 
ing approximate equilibria (mixed strategy profiles from 
which no player has incentive more than e to defect), and 
(2) exploring the algorithmic properties of special cases 
of games. The approximation front has been especially 
fertile, with several positive and negative results shown 
recently [3 [IE GEE] El. 

What is known about special cases of the Nash equi- 
librium problem? Several important cases are now 
known to be generic; these include, beyond the afore- 
mentioned 2-player games, win-lose games (games with 
0-1 utilities) (2, and several kinds of succinctly repre- 
sentable games such as graphical games [9 | and anony- 
mous games (actually, the even more specialized sym- 
metric games lfT4l ). For anonymous games, the gener- 
icity argument goes as follows: Any game can be made 
anonymous by expanding the strategy space so that each 
player first chooses an identity (and is punished is s/he 
fails to choose her/his own) and then a strategy; it is easy 



to see that, in this expanded strategy space, the utili- 
ties can be rendered in the anonymous fashion. Note, 
however, that this manoeuvre requires a large strategy 
space; in contrast, for other succinct games such as the 
graphical ones, genericity persists even when the num- 
ber of strategies is two IT51 . Are anonymous games eas- 
ier when the number of strategies is fixed? We shall see 
that this is indeed the case. 

How about tractable special cases? Here there is a 
relative poverty of results. The zero-sum two-player 
case is, of course, well known 11221 . It was general- 
ized in ifTTl to low-rank games (the matrix A + B is 
not quite zero, but has fixed rank), a case in which a 
PTAS for the Nash equilibrium problem is possible. It 
was also known that symmetric games with (about log- 
arithmically) few strategies per player can be solved ex- 
actly in polynomial time by a reduction to the theory of 
real closed fields 11231 . For congestion games we can 
find in polynomial time a pure Nash equilibrium if the 
game is a symmetric network congestion game fl2l . and 
an approximate pure Nash equilibrium if the congestion 
game is symmetric (but not necessarily network) and the 
utilities are somehow "continuous" [8|. Finally, in ll20"l 
Milchtaich showed that anonymous congestion games in 
graphs consisting of parallel links (equivalently, anony- 
mous games in which the utility of a player, for each 
choice made by the player, is a nondecreasing function 
of the number of players who have chosen the same 
strategy) have pure Nash equilibria which can be com- 
puted in polynomial time by a natural greedy algorithm. 

In this paper we prove two positive approximation 
results for anonymous games with a fixed number s of 
strategies. Our first result states that any such game has 
a pure Nash equilibrium that is e-approximate, where 
e is bounded from above by a function of the form 
/(s)A. Here A is the Lipschitz constant of the utility 
functions (a measure of continuity of the utility func- 
tions of the players, assumed to be such that for any 
partitions x and y of the players into the s strategies, 
\u(x) — u(y)\ < X\\x — y\\i). To get a sense of scale for 
A note that the arguments of u range from to n and so, 
if u were a linear function in the range [0,1], A would 
be at most —. f(s) is a quadratic function of the num- 
ber of strategies. That e cannot be smaller than A is easy 
to see (the matching pennies problem provides an easy 
example); the results of 10 for congestion games show 
a similar dependence on A (what they call "the bounded 
jump property"). We conjecture that the dependence on 
s can be improved to sX. Our proof uses Brouwer's fixed 
point theorem on an interpolation of the (discrete) best- 
response function to identify a simplex of pure strategy 
profiles and from that produce, by a geometric argu- 
ment, a pure strategy profile that is e-approximate, with 
e bounded as above. 



Our second result is a PTAS for the case of two strate- 
gies. The main idea is to round the mixed strategies of 
the players to some nearby multiple of e; then each such 
quantized mixed strategy can be considered a pure strat- 
egy, and, with finitely many -in particular 0(1/ e)— pure 
strategies, an anonymous game can be solved exhaus- 
tively in polynomial time in n, the number of players. 
The only problem is, why should the expected utilities 
before and after the quantization be close? Here we rely 
on a probabilistic lemma (Theorem B.U that may be of 
much more general interest: Given n Bernoulli random 
variables with probabilities p\, . . . ,p n , there is a way 
to round the probabilities to multiples of 1/k, for any 
k, so that the distribution of the sum of these n vari- 
ables is affected only by an additive O (l/\fkj in total 
variational distance (no dependence on n). This implies 
that the expected utilities of the quantized version are 

within an additive ±0 of the original ones, and 

an O (n 1 ^ J PTAS for two-strategy anonymous games 

is immediate. We feel that a more sophisticated proof 
of the same kind can establish a similar result for multi- 
nomial distributions, thus extending our PTAS to anony- 
mous games with any fixed number of strategies. 

1.1 Definitions and Notation 

An anonymous game G = (n, s,{u^}) consists of 
a set [n] — { 1 , . . . , n} of n > 2 of players, a set 
[s] = {1, . . . , s} of s > 2 strategies, and a set of ns util- 
ity functions, where it® with p 6 [n] and i E [s] is the 
utility of player p when she plays strategy i, a function 
mapping the set of partitions II® —1 = {(xi, . . . ,x s ) : 
Xi E Nq for all i E [s], X)i=i x i = n — 1} to the in- 
terval [0, 1] 0- Our working assumptions are that n is 
large and s is fixed; notice that, in this case, anonymous 
games are succinctly representable [23], in the sense that 
their representation requires specifying 0(n s+1 ) num- 
bers, as opposed to the ns n numbers required for gen- 
eral games (arguably, succinct games are the only mul- 
tiplayer games that are computationally meaningful, see 
11231 for an extensive discussion of this point). For our 
approximate pure Nash equilibrium result we shall also 
be assuming that the utility functions are continuous, in 
the following sense: There is a real A > 0, presumably 
very small, such that — < A • ||x — 

for every p E [n],i E [s], and x,y E This 
continuity concept is similar to the "bounded jump" as- 
sumption of [8 |. The convex hull of the set II® _ t will 
be denoted by A^_ x = {(x 1: . . . ,x s ) : Xi > 0, i = 

• • • > s > Ei=i x i =n-l}. 

'in the literature on Nash approximation utilities are usually nor- 
malized this way so that the approximation error is additive. 
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A pure strategy profile in such a game is a map- 
ping S from [n] to [s] . A pure strategy profile S is an 
e-approximate pure Nash equilibrium, where e > 0, 
if, for all p e [n], u p {p) (x[S,p}) + e > u p (x[S,p\) 
for all % e [s], where x[5,p] € n*_ 1 is the parti- 
tion (xi, . . . ,x s ) such that Xi is the number of players 
q G [n] — {p} such that S(q) = i. 

A mixed strategy profile is a set of n distributions 
S p ,p G [n], over [s]. A mixed strategy profile is an e- 
approximate mixed Nash equilibrium if, for all p € [n] 
and? e [s], ^i,...,5„wf(a;) + e > E Slt ... tSn u P (x) where, 
for the purposes of the expectation, i is drawn from [s] 
according to S p and x is drawn from n^_ 1 by drawing 
n — 1 random samples from [s] independently according 
to the distributions S q ,q ^= p and forming the induced 
partition. 

Anonymous games can be extended to ones in which 
there is also a finite number of types of players, and util- 
ities depend on how each type is partitioned into strate- 
gies; all our algorithms, being exhaustive, can be easily 
generalized to this framework, with the number of types 
multiplying the exponent. 

2 Approximate Pure Equilibria 

In this section we prove the following result: 

Theorem 2.1 In any anonymous game with s strategies 
and Lipschitz constant A there is an e-approximate pure 
Nash equilibrium, where e = 0(s 2 )A. 

Proof: We first define a function <j> from II* _ x to itself: 
For any x £ II* _ lt (f>(x) is defined to be (y\, . . . , y s ) G 
Hn-i such that, for all i e [s], yi is the number of all 
those players p among {1, . . . , n — 1} (notice that player 
n is excluded) such that, for all j < i, u P [x] > u P [x], 
and, for all j > i, u p [x] > u p [x\. In other words, <fr(x) 
is the partition induced among the first n—1 players by 
their best response to x, where ties are broken lexico- 
graphically. 

We next interpolate <f> to obtain a continuous func- 
tion (f> from A*_ 1 to itself as follows: For each x £ 
A* _ 1 let us break x into its integer and fractional parts 
x = x 1 + x F , where x 1 e and < xf < 1 

for all i = 1, . . . , s — 1. Let c[x / ] be the cell of x 1 , 
the set of all x' € such that, for alii < s — 1, 

x\ = x\ or x\ = x\ + 1. Then it is clear that x 
can be written as a convex combination of the elements 
of clx 1 ]: x = J2 x i£clx'] a i xj - We define <f>(x) to be 

Exi e c[i'] a i^ 3 ) 

It is possible to define the interpolation at each point 

x e A*_ x in a consistent way so that the resulting <j>(x) 

is a continuous function from the compact set A*^ 

to itself, and so, by Brouwer's Theorem, it must have 



a fixed point, that is, a point x* e A*_ x such that 
<j>(x*) = x*. That is, 

a j( f>(x j )=x* = Y a 3 x3 - 

By Caratheodory's lemma, equation (1) can be ex- 
pressed as the sum of only s of the 4>(x j ys x* — 

^2j=i li4>{ x ^)i an d it is eas Y to see mat it can t> e rewrit- 
ten as 

x* = <t>(x 1 )+Y / jMx J )-4>(x 1 )), (2) 

for some 7j > with = 1. 

Recall that, in order to prove the theorem, we need to 
exhibit e-approximate pure strategy profile. If x* were 
an integer point, then we would be almost done (modulo 
the n-th player, of whom we take care last), and x* itself 
(actually, the strategy profile suggested by the partition 
4>{x*)) would be essentially a pure Nash equilibrium, 
because of the equation x* = (f>(x* ). But in general 
x* will be fractional, and the various 4>{x^)\ will be 
very far from x* (except that they happen to have x* 
in their convex hull). Our plan is to show that x 1 (a 
vertex in the cell of x*) is an approximate pure Nash 
equilibrium (again, considered as a pure strategy profile 
and forgetting for a moment the n-th player). 

The term (j>{x l ) in equation (2) can be seen as a pure 
strategy profile P: Each of the n—1 players chooses the 
strategy that is her/his best response to x 1 . Therefore, 
in this strategy profile everybody would be happy if ev- 
erybody else played according to x 1 . The problem is, of 
course, that ^(x 1 ) can be very far from x 1 . We shall next 
use equation (2) to "move it" close to x 1 (more precisely, 
close to x* which we know is 2s-close in L\ distance to 
x 1 ) without changing the utilities much. Looking at one 
of the other terms of (2), (^(x 3 ) — (^(x 1 )), we can think 
of it as the act of switching certain players from their 
best response to x 1 to their best response to x^ . The cru- 
cial observation is that, since x 1 and xi are at most 2s 
apart in L\ distance ( they both belong to the same cell), 
the change in utility for the switching players would be 
at most 4sA. 

So, equation (2) suggests that a strategy profile close 
to x* can be obtained from P by combining these s — 1 
flows, with little harm in utility for all players involved. 
The problem is how to combine them so that the right 
individual players are switched (the situation is akin 
to integer multicommodity flow). We write each flow 
{(fiiyxi) — ^(x 1 )) as the sum of s 2 terms of the form .,, 
signifying the number of individual players moved from 
strategy i to strategy i'. We know that, for each such 
nonzero flow, there is a set of players Sj v C [n] which 
can be moved with only 4sA loss in utility. The union 
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over j of the (s — 1) sets S^, is denoted by Si t i> and 
the union over i' of the sets Si^i by Si. The following 
lemma can be proved by an application of Hall's Theo- 



Corollary 2.3 In any anonymous game, an e- 
approximate pure Nash equilibrium, where e is as 
in Theorem \2.1\ can be found in linear time. 



Lemma 2.2 There exist disjoint subsets T^i C Si t i>, 
i' = 1, . . . , s, such that, for all i' = 1, . . . , s, \Ta> \ = 

LEi= 2 7i/i,i'J- 

Proof: Let us consider the bipartite graph with ver- 
tex set Si U [s] and an edge from a player p E Si to 
a strategy i' € [s] if, for some j, p 6 S 3 iir . To estab- 
lish the result it is enough to show that there exists a 
generalized matching of players to pure strategies — in 
which every player is matched to at most one pure strat- 
egy, so that, for all i', strategy i' is matched with at least 

Ri' ■= LEj=2 lifli'l Players. 

By Hall's theorem, such a matching exists if every set 
of strategies J C [s] "knows" at least 2~2i>ej ^ pl av ~ 
ers. Observe that, for all j, the family of sets {Sf^}^ 
are disjoint. Hence 



£4. 



< 



U S L' 



i'ej 



< 



U s ^ 



where T(J) represents the neighborhood in Si of the 
pure strategies of the set J. From the above equation it 
follows that 

E^E4^E^-rai<iru)i 

j t'Gj j 

which completes the proof. ■ 

Thus, by moving the players in X^y from i to for 
all pairs of i, i', we obtain from strategy profile P a 
new strategy profile P in which each player's strategy 
is within 4s A from their response to x 1 , and such that 
the corresponding partition x* is, by equation (2) and 
the roundings in the lemma, at most 2s 2 away from x*, 
and hence at most 2s more away from x 1 ; let's call the 
distance bound D = 2s 2 + 2s. Since, for all players 
— except for the last of course, P is an 4sA-approximate 
response to x 1 and P is within distance D from x 1 , it 
follows that P is a 4(£> + s)A-approximate best response 
to itself. 

Finally, we turn to player n. Adding the best response 
of player n to P, and subtracting what player i plays in 
P, we get a profile that is 2 away, in L\ distance, from 
P, thus making P a 4(D + s + l)A-approximate Nash 
equilibrium and completing the proof. ■ 

Since LT^_ 1 has 0(n s ) points, and this is the length 
of the input, the algorithmic implication is immediate: 



3 Approximate Mixed Nash Equilibria 

3.1 A Probabilistic Lemma 

We start by a definition. The total variation distance 
between two distributions P and Q supported on a finite 
set A is 



\ E \nc 



Q(a)\. 



Theorem 3.1 Let be arbitrary probabilities, 

Pi € [0, 1], for i = 1, . . . , n, and let {Xi}f =1 be in- 
dependent indicator random variables, such that Xi has 
expectation £[Xi] = pi, and let k be a positive integer. 
Then there exists another set of probabilities {c?i}™ =1 , 
qi G [0,1], i = 1, . . . , n, which satisfy the following 
properties: 

1. \\qi-pi\\ = 0(1/ k), foralli = l,...,n 

2. qi is an integer multiple of j, for all i = 1, . . . , n 

3. if {Yi}f =1 are independent indicator random vari- 
ables such that Yi has expectation £\Yi] — qi, then, 



0(k 



-1/2-. 



and, moreover, for all j = 1, . . . , n, 



= oik- 1 / 2 ). 



From this, the main result of this section follows: 

Corollary 3.2 There is a PTASfor the mixed Nash equi- 
librium problem for two-strategy anonymous games. 

Proof: Let (p\, . . . ,p n ) be a mixed Nash equilibrium 
of the game. We claim that (qi, . . . , q n ), where the 
qi's are the multiples of 1/fc specified by Theorem l3.ll 
constitute a 0(l/v/c)-approximate mixed Nash equilib- 
rium. Indeed, for every player i E [n] and every strat- 
egy m E {1,2} for that player let us track the change 
in the expected utility of the player when the distribu- 
tion over II 2 ^ defined by the {pj}j^i is replaced by 
the distribution defined by the {qj}j^i. It is not hard to 
see that the absolute change is bounded by the total vari- 
ation distance between the distributions of the 2~2j^i Xj 
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and the @ where Xj, Yj are indicators corre- 

sponding to whether player j plays strategy 2 in the dis- 
tribution defined by the pi's and the q^s respectively, i.e. 
£[X, ] = pj and £ [Yj] = qj. Hence, the change in utility 
is at most 0(1/ Vk), which implies that the q^s consti- 
tute an 0(l/v / ^)-approximate Nash equilibrium of the 
game, modulo the following observation: with a trivial 
modification in the proof of Theorem B.ll we can ensure 
sure that, when switching from pi's to qi's, for every i, 
the support of qi is a subset of the support of pi. 

To compute a quantized approximate Nash equilib- 
rium of the original game, we proceed to define a related 
(k + l)-strategy game, where k = O ( and treat the 
problem as a pure Nash equilibrium problem. It is not 
hard to see that the latter is efficiently solvable if the 
number of strategies is a constant. The new game is de- 
fined as follows: the z-thpure strategy, i = 0, . . . , k, cor- 
responds to a player in the original game playing strat- 
egy 2 with probability ^ . Naturally, the payoffs resulting 
from a pure strategy profile in the new game are defined 
to be equal to the corresponding payoffs in the original 
game, by the translation of the pure strategy profile of 
the former into a mixed strategy profile of the latter. In 
particular, for any player p, we can compute its payoff 
given any strategy i S {0, . . . , k} for that player and 
any partition x € FLi-i °^ t ^ le otr,er players into k + 1 
strategies, in time n ^ 1 / 6 ' overall, by a straightforward 
dynamic programming algorithm, see for example [24]. 
The remaining details are omitted. ■ 

Remark: Note that it is crucial for the proof of Corol- 
lary 13.21 that the bound on the total variation distance 
between the Xi an d tne Yli ^ m tne statement of 
the Theorem 13.11 does not depend on the number n of 
random variables which are being rounded, but only on 
the accuracy \ of the rounding. Because of this re- 
quirement, several simple methods of rounding are eas- 
ily seen to fail: 

• Rounding to the Closest Multiple ofl/k: An easy 
counterexample for this method arises when pi :— 
—, for all i. In this case, the trivial rounding would 
make qi := 0, for all i, and the total variation dis- 
tance between the Xi and the Yi would be- 
come arbitrarily close to 1 — -, as n goes to infinity. 

• Randomized Rounding: An argument employing 
the probabilistic method could start by indepen- 
dently rounding each pi to some random qi which 
is an integer multiple of ^ in such a way that 
£[qi] = Pi- This seems promising since, by inde- 
pendence, for any £ — 0, . . . , n, the random vari- 
able Pr[J^ j Yi = £], which is a function of the qi's, 

2 Recall that all utilities have been normalized to take values in 
[0,1]. 



has the correct expectation, i.e. £[PrEi^i] = 
£} = Pr[£\Xi = £}. The trouble is that the ex- 
pectation of the random variable Pr[^ Yi = £] 
is very small: less than 1 for all £ and, in fact, in 
the order of of 0(l/n) for many terms. Moreover, 
the function itself comprises of sums of products on 
the random variables qi, in fact exponentially many 
terms for some values of £. Concentration seems to 
require k which scales polynomially in n. 

Proof Technique: We follow instead a completely dif- 
ferent approach which aims at directly approximating 
the distribution of the J2 i Xi- The intuition is the fol- 
lowing: The distribution of the Xi should be close 
in total variation distance to a Poisson distribution of the 
same mean Y^iPi- Hence, it seems that, if we define 
<7i's — which are multiples of i — in such a way that the 
means Y^iPi anc ' J2i 1i ^ close. then the distribution 
of the Y should be close in total variation distance 
to the same Poisson distribution and hence to the distri- 
bution of the J2i Xi by triangle inequality. 

There are several complications, of course, the main 
one being that the distribution of the J^. Xi can be 
well approximated by a Poisson distribution of the same 
mean only when the p.^'s are relatively small. When the 
Pi's take arbitrary values in [0, 1] and n scales, the Pois- 
son distribution can be very far from the distribution of 
the J^i Xi- In fact, we wouldn't expect that the Pois- 
son distribution can approximate the distribution of ar- 
bitrary sums of indicators since its mean and variance 
are the same. To counter this we resort to a special kind 
of distributions, called translated Poisson distributions, 
which are Poisson distributions appropriately shifted on 
their domain. An arbitrary sum of indicators can be now 
approximated as follows: a Poisson distribution is de- 
fined with mean — and, hence, variance — equal to the 
variance of the sum of the indicators; then the distribu- 
tion is appropriately shifted on its domain so that its new 
mean coincides with the mean of the sum of the indica- 
tors being approximated. 

The translated Poisson approximation will outper- 
form the Poisson approximation for intermediate values 
of the pi's, while the Poisson approximation will remain 
better near the boundaries, i.e. for values of pi close to 
or 1. Even for the intermediate region of values for the 
Pi's, the translated Poisson approximation is not suffi- 
cient since it only succeeds when the number of the indi- 
cators being summed over is relatively large, compared 
to the minimum expectation. A different argument is re- 
quired when this is not the case. Our bounding technique 
has to interleave these considerations in a very delicate 
fashion to achieve the approximation result. At a high 
level, we treat separately the Xi& with small, medium 
or large expectation; in particular, for some a G (0, 1) 
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to be fixed later, we define the following subintervals of 

[0,1]: 



1. C(k) 



0, ^jr- ) ■ interval of small expectations; 



2. Mi(k) := 
expectations; 



■L^— , ) : first interval of medium 



3. M 2 (k) : 

medium expectations; 



, 1 — ) : second interval of 



4. H(k) 
tions. 



1 



interval of high expecta- 



Denoting C*(k) := {i \ SIX,] € C(k)}, we establish 
(Lemma|3~9l) that 



£ £ * 

ie£*(fc) ie£*(fe) 



0(k 



-1/2N 



and similarly for M,\(k) (Lemma [3. 12b . Symmetric ar- 
guments (setting X[ = 1 — X{ and Y! = 1 — 3^) im- 
ply the same bounds for the intervals M.2{k) and TL(k). 
Therefore, an application of the coupling lemma implies 
that 



o(k-^), 



which concludes the proof. The details of the proof are 
postponed to Section [3~3l The proof for the partial sums 
Ei^j Xi and Ylijtj follows easily from the analy- 
sis of Section 1331 and its details are skipped for this ex- 
tended abstract. The next section provides the required 
background on Poisson approximations. 

3.2 Poisson Approximations 



Definition 3.4 (| 25 1) We say that an integer random 
variable Y has a translated Poisson distribution with 
paremeters /i and a 2 and write 

£(Y)=TP(u 1 a 2 ) 

if C(Y — LjLt — a 2 ] ) = Poisson{u 2 + {[i — o" 2 }), where 
{[i — <J 2 } represents the fractional part of fi — a 2 . 



Theorem 13.51 provides an approximation result for the 
translated Poisson distribution using Stein's method. 

Theorem 3.5 (|25|) Let Ji, . . . , J n be a sequence of in- 
dependent random indicators with £[Ji] — Pi- Then 



£ J t -TP(fi,a 2 ) 



< 



ve;u^(i-po+2 



E?=iP«(i-Pi) 

where fj, = J2i=i Pi and ^ = ELi PiO- ~ Pi)- 

Lemmas l3.6l and [3T7l provide respectively bounds for the 
total variation distance between two Poisson distribu- 
tions and two translated Poisson distributions with dif- 
ferent parameters. The proof of |3.6| is postponed to the 
appendix, while the proof of |3.7| is provided in [|3~| . 

Lemma 3.6 Let Ai, A 2 G K + \ {0} . Then 



| \Poisson(Xi) — Poisson{\2) 



< e 



Ai-A 2 



Lemma 3.7 fl|3ll) Let p,i,fi2 & K an d £ 
{0} be such that — a\\ < — cfj. Then 

\\TP{^,a 2 )-TP{pi 2 ,n 2 )\\ 
I Mi 



< 



M2I Jf?_ 



The following theorem is classical in the theory of 
Poisson approximations. 

Theorem 3.3 (|2|) Let Ji, . . . , J n be a sequence of in- 
dependent random indicators with S[Ji] — Pi- Then 



Ji — Poisson ( pi 



i=l 



\i=l 



< 



En 
i= iPi 



As discussed in the previous section, the above bound is 
sharp when the indicators have small expectations, but 
loose when the indicators are arbitrary. The following 
approximation bound becomes sharp when the previous 
is not. But first let us formally define the translated Pois- 
son distribution. 



iec(k) *i is 



3.3 Proof Theorem [3TT1 

In this section we complete the proof of Theorem l3.ll 
As argued above, it is enough to round the random vari- 
ables {Xi\ ieC ,( k) into random variables {Yji&C'ik) so 
that the total variation distance between the random vari- 
ables x c ■= E ie £«(fc) x i and yc ■= E 

small and similarly for the subinterval A4i(k) 

Our rounding will have different objective in the two 
regions. When rounding the X/s with i £ C* (k) we aim 
to approximate the mean of Xc as tightly as possible. On 
the other hand, when rounding the A"; ' s with i S M. * (k) , 
we give up on approximating the mean very tightly in 
order to also approximate well the variance. The details 
of the rounding follow. 
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Some notation first: Let us partition the interval 
[0, 1/2] into \k/2~] subintervals Iq,Ii, 



I[k/2\ where 



1 2 

k'k 



! Lfe/2j 



[k/2\ 



1/2 



The intervals I , . . . , I\k/2\ define the partition of 
C*(k) U Mt(k) into the subsets 1$, If, . . . , I,* fc/2J , 
where 



/; ={i\£[Xi] el j },j = o,i,...,[k/2\. 

For all j G {0, . . . , Lfc/2J} with J* ^ 0, let J* 
{ji, J2, ■ ■ ■ ,jnj and, for all i G {1, . . . , n,}, let 



J 



f[Jf i4 ]and^:=pJ"-( 



We proceed to define the "rounding" of the Xj's into 
the li's in the intervals C(k) and jMi(fc) separately. 



Hence, the assertion following Step ii(b) is satisfied. Fi- 
nally, note that, for all j, 

rij 



£4 

i=l 



£ 



Therefore, 



Lfc°J— 1 f»j ^'"J— 1 ™j 

E J2^ = E E^ + e °" e Lfc°j' 

j=0 i=l j=0 i=l 

which implies 

Lemma 3.8 | £ ie£ » (fc) ^] - E, 6£ . W < 



Interval C(k) := 



^ 

u > k 



of small expectations. 



Observe first that C(k) = Iq U . . . U /i/-<»j_i and define 
the corresponding subset of the indices C*(k) := Jq U 



The following lemma characterizes the total variation 
distance between £ ie£ . (fe) X t and £ ie£ , (fc) F*. 



Lemma 3.9 



iG£*(fe) Jj 



< 



U /^j_ r We define the t e £*(fc), via the p roof . Ry lemmaE 3] we have that 



following iterative procedure. Our ultimate goal is to 
round the JQ's into Y^'s appropriately so that the sum of 
the expectations of the Xj's and of the Yi's are as close 
as possible. The rounding procedure is as follows. 

i. e := 0; 

ii. for j :=0to [k a \ - 1 



(a) S r .= ej+YZA\ 

Si 



(b) m,j 



k- 1 



; Ej+i 



"3 k' 



{assertion: rrij < rij - see justification next} 
(c) set q\ := < 2 4- for i = 1, ...,rrij and := f 



for i = m j + 1 , . . . , rij ; 

(d) for all i G {1, ...,n 3 -}, let be a {0,1}- 
random variable with expectation q\ ; 

iii. Suppose that the random variables Yj, i G £*(£;), 
are mutually independent. 



53 — Poisson 53 pi 
ie£*(fc) Ue£*(fc) 



< 



£i6£*(fc) P« 



and 



53 *S--Poi 

ie£*(fe) 



i6£*(fc) 



< 



Sie£*(/c) 1i 

J2iec*(k) 9i 



where pi := £[Xi] and qi := £[Yi] for all i. The follow- 
ing lemma is proven in the appendix. 

Lemma 3.10 For any u > andany set {pi}i£j, where 
Pi G [0, u],for all i G T, 



< u. 



Using Lemmas 13.101 13.81 and 13.61 and the triangle in- 
equality we get that 



It is easy to see that, for all j G {0, . . . , [k a \ — 1}, 
€j < this follows immediately from the description 
of the procedure, in particular Steps i and ii(b). This 
further implies that rtij < rij, for all j, since at Step 
ii(b) we have 



i i ii 1 '*7 



E E ^ 

ieC*(k) ie£*(fc) 



< 



1 1 Q 1 

where we used the fact that e^— e _ fc<-|< fcl i a . for 
sufficiently large k. M 
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Interval Mi(k) 
tions. 



J^J- , ^2 J : medium expecta- 



Observe first that Ali (A;) = /i^ai U . . . UJifc/aj and de- 
fine the corresponding subset of the indices M\(k) := 
IT ka j U . . . U Jj* fc/2J . We define the Y it i S .M*(A;)> via 
the following procedure which is slightly different than 
the one we used for the set of indices C*{k). Our goal 
here is to approximate well both the mean and the vari- 
ance of the sum EieM* (fc) -^i- In fact, we will give up 
on approximating the mean as tightly as possible, which 
we did above, in order achieve a good approximation of 
the variance. The rounding procedure is as follows. 

for j := [k a \ to |_§J 
(a) -V \T 



(b) m,- 



Si 

k- 1 



(c) set q\ 
for i = m 



2±i fori 
1, 



1,. 



, nij and q{ : \ 



3 * * * 5 j ' 

(d) for all i G {1, rij}, let be a {0,1}- 
random variable with expectation q\ ; 

Suppose that the random variables Y\, i G J\A\(k), 
are mutually independent. 



Lemma [3. 1 1 1 characterizes the quality of the rounding 
procedure in terms of mean and variance. Defining 

:= £ i6/ . £[Xi] - Eiei* we have 

3 3 

Lemma 3.11 For all j G { lk a \ , . . . , [f J } 

(a) = ESi^-m,i 

(b) < < i 

(c) E ie ,; Var[X,] = ^i(l-f) + 

(i-f)££i<^-E£i$) 2 

(d) E ie/; Varft] = „^ (1 - i) + m,i (l - 2^1) 

(e) E l6 /; Var[X,] - Varpfl = (l - f ) £ + 

(m^-i:^ (sir). 

The following lemma bounds the total variation dis- 
tance between the random variables Ei£M*(fc) an ^ 

E 



i£>lj(fe) 



Lemma 3.12 



weM*(fc) ^ 



EieMf(fc)^ E 
O (V^ 1 ) + 0(k- a ) + 0(fc-5) + o(fc-< 1 -«). 



< 



Proof: We distinguish two cases for the size of A4*(k). 
For some (3 G (0, 1) such that a + j3 > 1, let us distin- 
guish two possibilities for the size of |.M*(fc)|: 

a. \M\{k)\ < k^ 

b. \M\{k)\ > k? 

Let us treat each interval separately in the following lem- 
mas. 

Lemma 3.13 If \M$(k)\ < k? then 



E e y* 



< 



Proof: The proof follows from the coupling lemma and 
an easy coupling argument. The details are postponed to 
the appendix. ■ 

Lemma 3.14 If\Ml(k)\ > k 13 then 

E E y 

ieMt(k) i£Ml{k) 

< O (V 2 ^) + 0{k- a ) + O(fc-i). 
Proof: By lemma [331 we have that 



< 



Eie7W*(fc) P*(l _ Pi) 



and 



< 



E 



ieMl(k) 1i 



q! (i - ft) + 2 



EieMJ(fe) ft) 

where ^i = Eie>q(fc)Pi' ^ = Eie>q(fc) ft- CT ? = 

Y. ie Ml(k)Pi( l -Pi)< a l = EieM^fe) - *) and 
Pi := qi := £[Yi] for all i. The following lemma 

is proven in the appendix. 

Lemma 3.15 For any u G (0, \) and any set {pi}i£j, 
where pi G [it, |],/or all i G X, 



E ie iPK 1 -Pi) 



< 



(1 + 2u + Au 2 - 8u 3 ) 



EiezPiC 1 -^) " v /1 6|^|u(l-W"4u 2 + 4u 3 ) 
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Putting Everything Together. 



and X = 



Applying the above lemma with u 
M*(k), where recall |,M*(A;)| > k@ the above bound 
becomes 



(1 + 2u + 4u 2 - 8u 3 ) 
y/16\l\u(l - u - Au 2 + Au 3 ) 

which implies 



Xi-TPfao?) 



= o 



= o(k~ s± ^) 



(k-^) (1) 



and 



Yi-TP^a 

ieMl(k) 



= 0[k- d± ^ 1 ^, (2) 



where we used that, for any set of values {pi S 

Mi{k)} ieMl{k) , 



< 



Pi(l -Pi) " \Mt(k)\Wp-(l-^p-) 

= o (V^- 1 )) 

and similarly for any set of values {qt S 
Mi{k)} ieMl{k) . 

All that remains to do is to bound the total varia- 
tion distance between the distributions TP(/j,i, a 2 ) and 
TP(fi2, of) f° r tne parameters n\, a 2 , \i-z, a\ specified 
above. The following claim is proved in the appendix. 

Claim 3.16 For the parameters specified above 

I |TP(/*i, 4) - TP{ m ,al)\\ < 0(k- a ) + Oik' 1 / 2 ). 



Claim l3~T6l along with Equations (Q3 and d2j and the tri- 
angle inquality imply that 



Suppose that the random variables {Yi}i defined above 
are mutually independent. It follows that 



= (AT (1 -° 



Ok 



+ 0(k- a ) + 0{k~i) + 0{k-^~^). 

Setting a — (3 = | we get a total variation distance 
of O (fc -1 / 4 ). A more delicate argument establishes an 
exponent of — \ . 



4 Open Problems 

Can our PTAS be extended to arbitrary fixed number 
of strategies? We believe so. A more sophisticated tech- 
nique would subdivide, instead of the interval [0, 1] as 
our proof did, the (s — 1) -dimensional simplex into do- 
mains in which multinomial (instead of binomial) distri- 
butions would be approximated in different ways, possi- 
bly using the techniques of |26l . This way of extending 
our result already seems to work for s = 3, and we are 
hopeful that it will work for general fixed s. 

Can the quadratic, in s, approximation bound of our 
pure Nash equilibrium algorithm be improved to linear? 
We believe so, and we conjecture that sX is a lower 
bound. 

We hope that the ways of thinking about anonymous 
games introduced in this paper will eventually lead to al- 
gorithms for the practical solution of this important class 
of games. Moreover, a technique involving probability 
rounding similar to the one used here yields a quasi- 
polynomial time approximation scheme for finding a 
Nash equilibrium in general normal form games with a 
fixed number of strategies, as well as for large classes of 
graphical games of this sort (work in progress). Improv- 
ing this to polynomial is another important open prob- 
lem. 

Acknowledgment: We want to thank Uri Feige for a 
helpful discussion. 
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APPENDIX 



A Missing Proofs 

Proof of lemma 1X6} Without loss of generality assume that < Ai < A2 and denote 8 = A2 — Ai. For all i E 
{0, 1, . . .}, denote 

Pi = e~ Xl ^- and q, = e^ 2 ^. 

Finally, define I* = {i : pi > qi}. 



We have 



E & - 9i\ = E (p* - *) < E 7f ( e ~ AlA l - e ~ Al ~* A i) 

iGX* 

= E^- Al Ai(l-e- 5 ) 
n , 

<(l-e- 5 )E^- Al Al = l 



2 

i^X* i£T* 



On the other hand 



E \Pi-Qi\= E fe-P«)< E ^(e- Al (Ai+<5) l -e-^Al) 

= E^ Al (( A i + ,5 ) J - A i) 

" 1 

^E-! e_Al (( A i + (5 ) l - A i) 

2 = 

n 1 n 1 



i£2* igl* 



= e s ' 



i=0 t=0 
= e 5 -l. 

Combining the above we get the result. ■ 

Proof of lemma UJdl For alH G X and any choice of values pj £ [0, u], j G T \ {i}, define the function 

, , . x 2 + A 
/OO = 



x + B 

where A = Pj and 5 = 52jei\{i} Pj' observe that A < uB. 



If A = B = then /(x) — x so f achieves its maximum at x = u. 
If A ^ ^ B, the derivative of / is 

_ -A + x(2B + x) 
1 [X) " (5 + xf ■ 

Denoting by h(x) the numerator of the above expression, the derivative of h is 

h'(x) = 2B + 2x> 0,Vx. 

Therefore, /i is increasing which implies that h(x) = has at most one root and hence f'(x) = has at most one root 
since the denominator in the above expression for f'(x) is always positive. Note that /'(0) < whereas f'(u) > 0. 
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Therefore, there exists a unique p £ (0, u) such that f'(x) < 0, Vx <E (0, p), f'(p) = and f'(x) > 0, Vx <E (p, u), 
i.e. / is decreasing in (0, p) and increasing in (p, u). This implies that 

m r ax , f( x ) = max{/(0), f(u)}. 

x£[0,u] 

But f(u) = > 5 = /(0) since A < uS. Therefore, max, f(x) = f(u). 

From the above it follows that, independent of the values of J2jei\{i} Pi an( ^ Ylj£X\{i}Pi< f( x ) * s maximized at 
x = u. Therefore, the expression ^' £I ' is maximized when Pi — u for all % G X. This implies 



Proof of lemma 1X77} For (a) we have 

i=l i=l 

= ^5| -m,--. 



ieJJ i=l i=l 



To get (b) we notice that 



1 i 



i=l 



Sj - (Sjk-iSjk- [Sjk}))-r 



k 

For (c), (d) and (e), observe that, for all 6 /*, i 6 {1, . . . , Tij}, 



~ + - ~ + si 



Var[^J = gf' - (<^) 2 - > £[Yji] ' ' " ;: ! 1 1 



f K»]~p-' i e {rrij + l,...,n j } 

ie {l,...,mj} 
i e {mj + 1, . . . , rij} 



f 2+1 (j+ 1) 2 , p fi A 



2. _ 2 
. k P'' 



12 



Hence, 



£ Var[Xi] = £ %r[**] = 2 £ [JQJ - n, =L - 4 E ^ - £ 



i=l 



fc 2 



i=i i=i 



!-f)E^-E(^ 



i=l i=l 



and 



E - E Var i Y ^ = E f 



i = l 



r 2j + i 



1 ^ 2j + 1 

mi 



E - E yar M 



iez; 

;4H)+H)g«-t(*> 2 )- 



'7 1' Tj+ m ifcl' 



2j + l 



Proof of Lemma 13.751 The coupling lemma implies that for any joint distribution on U {Yi}, the following is 

satisfied 



E E * 

A union bound further implies 



< Pr 



E E * 

ieMl(k) ieMl(k) 



Pr 



E E « 



< Pr 



V *i ¥> Y i 

teMl(k) 



< J2 p *i x i^ Y i\ 



Hence for any joint distribution on U {Yi}i the following is satisfied 



E E * 



(3) 



Let us now choose a joint distribution on {Xi}i U in which, for all i, Xj and are coupled in such a way that 
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This is easy to do since by construction \pi — qi\ < r, for all i. Plugging in Formula (f3]i the particular joint distribution 
just described yields 



ieMl(k) 



< \Ml(k)\ 1 



A' 



Proof of lemma 13773} For all z 6 X and any choice of values pj 6 [u, |], j £ T \ {i}, define the function 



/(*) 



x 3 (l - x) + A 



l 

u, — 

' 2 



(x(l-x) + 5) 2: 
where A = £ ieX \ {i } (1 - Pj) and B = Ejei\{<} P^ 1 - Pi)- 
For the sake of the argument let us extend the range of / to [0, |]. The derivative of / is 

A(-2 + 4x) + x 2 (3B + x- ABx - x 2 ) 



fix) = 



(B + x - x 



2N3 



where note that the denominator is positive for all x £ [0, ^ ] . Denoting by h(x) the numerator of the above expression, 
the derivative of h is 



h'{x) = 4A + (1 - 2x)x 2 + 2x(x - x 2 ) + 6Bx(l - 2x) > 0, Vx e 
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Therefore, h is increasing in (0, |) which implies that = has at most one root in (0, i) and hence f'(x) = 
has at most one root in (0, |) since the denominator in the above expression for f'(x) is always positive. Note that 
/'(0) < whereas > 0. Therefore, there exists a unique p G (0, |) such that /'(sc) < 0, Vx e (0, p), f'(p) = 

and f'(x) > 0, Vie € (p, |), i.e. / is decreasing in (0, p) and increasing in (p, ~). This implies that 

max /(z)=max{/(u),/(l/2)}. 

xG[u,l/2] 

Hence, the expression (^" EI p'(i_ p .))2 is bounded by 



which we further bound by 



where 



The derivative of g is 



m6 Ex|} (f + - m)u(l - u)) 2 



max q(x) 
xe[o,|z|] 



^ + (\l\~x)u 3 (l-u) 



</(*) 



4|2>(1 + u - 6u 2 + 12u 3 - 8u 4 ) - (1 - 2u - 16u 3 + 48m 4 - 32u 5 )x 



(1 - 2?i)- 1 (4|X|(l - u)u + (1 - 2u) 2 xf 
where note that the denominator is positive for all u e [0, |] and the numerator is of the form — B{u)x where 

r 



:= 4|J|u(l + u - 6u 2 + I2u s - 8m 4 ) > 0,Vu e 



and 



:= 1 - 2u - 16w d + 48u 4 - 32u° > 0, Vu G ( 0, - 
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Hence, if we take ( := -g^, g'(x) > 0, Vrr G (0, £), <?'(C) — an d </( x ) < 0, Va; e (C, +oo), i.e. g is increasing in 
(0, C) and decreasing in (£, +oo). This implies that g achieves its maximum at x := £. The maximum value itself is 

, _ (l + 2u + 4u 2 -8u 3 ) 2 



16|X|m(1-u-4u 2 + 4u 3 )' 
This concludes the proof. ■ 

Proof of claim \3.16\ From Lemma [3^71 if follows that 



TF( Pll( rf)-TP( M2 ,^) <max 



2 ' 

til a{ (72 



Denoting J = { [k a \ , . . . , [k/2\ - 1}, we have that 



M i-M2= E wi- E ^ = EE( £ w-^) = E^ 

ieMJ(fc) ieA<I(fc) j£Ji€l* j£J 



Similarly 



Finally, 



k J \ k 

jeJiei* jeJ \ '" x 7 v 7 i=i i=i 



> 



El 


H0- 






Ei 











'fc 2 



^=ee^]=e(»4( i -{) + ^K 1 -^ 

je.Ji.Ei* je.J v v 7 v 



fc V k 



>ES(j(*-i)-D- 



°? - *s = £ f . £ MJf.] - £ y^nj = E ((i - 1) o + (-^ - £ (^) 2 ) ) » 

where observe that a\ — erf > 0, since 



i=l / x 

kJ" J k" 



1 - -t ) - 
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We proceed to bound each of the terms k '~' T J l+1 , Itl^nA anc j separately. We have 



[Ml - Mgj = ^1 - EjgjCj 



^jeJ n w (J (* - i) - 1) 



< 



Ejej^iO'^-i)- 1 ) 



< i ■ = where Z = |{j e J|nj > 1}| 

Ejej^.^iO'^-i)-!) 

1 



Ej >1 ( 



j(fc-j)-l 
— 



< 



< 



^Lfe°J+^-i ( 3(k-j)-l \ 



Note that 



J2+Z-1 



J2 (j(k-3)-l) = lz(-7-6jj + 6 J1 (l + k-Z) + 3k(-l + Z) + 3Z-2Z 2 ). (4) 

For ji = [A: a J , let us define 

1 J2+Z ~ 1 1 
F ^ := ^ E (j(fc-j)-l)^^(-7-6 Jl 2 + 6. 7l (l + fc-Z) + 3A : (-l + Z) + 3Z-2Z 2 ) 

i=ii 

The derivative of F is 

7 + 6j 2 +3fc-6,n(l + fc)-2Z 2 7 + 6Lfc"J 2 + 3fc~6Lfc"](l + fc)-2Z 2 ^ n 
= i ^ = L - — J - ^ — ^ '- < 0, for large enough k. 

Hence F is decreasing in [1, k/2 — [k a \] so it achieves its minimum at Z = k/2 — [k a \ . The minimum itself is 

F(kp _ , n) . -14 + ^-4^^ + 4^ + ^ _ m 



Hence, 

iMi -M2I 

Similarly, we get 

[Mi - M2I 

0-2 

It remains to bound the terms <T i~^l+ 1 an( j [£V^J+1 _ ], ave 



= 0(fc- 1 /2 ) . 
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l^-^fl + l < 1 + E je ./(0+m J ^) 



£, gJ £ V (* - i) - 1) 

■ V " „ (where ZHO^K,!},) 

fcZ 1 + M 



E iG j «j (i ( fc - 3) - 1) Ejej «j U ( k - j) - !) 



The second term of the above expression is bounded as follows 

1 + M < 1 M 

Ejej »j (i ( fc - i) - 1) " Eje,/ «j (i - j) - i) Ejej (i ( fc - i) - 1) 

1 M 

" Ejej n j U ( k - j) - 1) E je j (i ( fc - i) - 1) 
1 1 

- Lfc«J (fc - Lfc«j ) - i + E jeJ 1 (Lfc Q J (fc - Lfc Q J ) - i) 

< ? = r>(h- 1 - a \ 

- [k a \(k- [k<*\)-l y >' 

The first term is bounded as follows 

kZ kZ 

E je .J U & - I) 1) - E r , : „ , U (k I) 1) 

1 



< 



< 



^[A-j+Z-l ( ](k-3)-l \ 
l^j=\k"\ \ kZ ) 

1 

min i<z<fe/2-Lfe Q J \E i= Lfe°j ^ — kz — )] 



From above 

h+z-i 



+ I 

V ( k - 3) - !) = 6 Z(_7 ~ 6 - ? i + 6 - 7l(1 + fc - Z ) + 3fc (-! + Z ) + 3Z - 2Z ^ 

3=31 



For ji = [k a \ , let us define 

32+Z-l 



, 32+Z-l 

G ^ := Zk^ U {k ~ j) ~ 1} = 6fc ( ~ ? ~ ^ + 6jl(1 + fc " Z) + 3fc(_1 + Z) + 3Z ~ 2Z2) 

3=3l 



The derivative of G is 

3 - 6ji + 3fc - AZ 3-6Lfc«J + 3fc-4Z 

G (Z) = = — ^— > 0, for large enough k since Z < fc/2. 

6fc 6fc 

Hence G is increasing in [1, — [k a \] so it achieves its minimum at Z = 1. The minimum itself is 

G(i) = - 6 - 6 ^ fc 2 + 6 L fcQ J fc = n (n . 
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Hence, 

which together with the above implies 

CT i 

Similarly, we get 

+ 1 = 0(fc -). 

Putting everything together we get that 

I |TP(pi, <t?) - TP( M2 , a 2 2 )| I < 0(fc- Q ) + Oik' 1 ' 2 ). 
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